MULTIPLE VARIANT (A/B TEST)

Introduction

A/B Testing (also known as split testing) is a method for comparing two or more variations of content to determine which performs better. In the Chisquares platform, the A/B Test question type allows users to randomly present different question variations to respondents, ensuring unbiased data collection. This feature is particularly useful for optimizing survey design, assessing content effectiveness, and evaluating user engagement.

This manual provides a comprehensive guide to setting up and managing A/B Test questions within Chisquares, covering basic setup, advanced features, and step-by-step instructions.

Features

• Question Text Input: Create and format the core question prompt.
• Response Options: Define selectable answers manually or dynamically.
• Required Toggle: Make the question mandatory to proceed.
• Random Assignment: Each participant is randomly assigned to view one media file (image, video, or audio) before answering a question.
• Media Upload: Users can upload multiple media files to be randomized among participants.
• Foundation Question Support: Compatible with foundational question types such as Single Value Text, Likert Scale, Multiple Choice (MCQ), Sliding Scale, Yes/no, Multiple Responses, Dropdown, and Prompts.

Basic Setup

• Define Question Variants: Create two or more variations of the same question.
• Assign Answer Type: Choose from supported response options.
• ERandomization: Ensure each respondent receives only one variant.
• Required Toggle: Make the question mandatory to proceed.
• Media Upload: Users can upload multiple media files to be randomized among participants.

Advanced Features

• Conditional Display Logic/Non-random Allocation: Show variants based on predefined set up condition.

Step-by-Step Guide

Step 1: Create a New Question

1. Log into your Chisquares Investigator Portal.
2. Navigate to the Survey Design section.
3. Click Create a New Question.

Step 2: Select the Question Type

1. In the question type section, select Group Allocation Questions.
2. Choose Multiple Variant (A/B Test) from the list of available question types.
3. Click Use Selected questionnaire item.

Step 3: Choosing a Foundational Question Type

1. Click Change, and select one of the following foundational question types:
   • Single Value Text
   • Likert Scale
   • Multiple Choice (MCQ)
   • Sliding Scale
   • Yes/No
   • Multiple Responses
   • Dropdown
   • Prompts

Step 4: Add Your Question

1. Enter your question in the provided text box.
   Example: Based on the packaging shown, how harmful do you think this tobacco product would be if smoked daily?

2. Apply formatting using the toolbar.

3. Configure the foundational question settings as required.

4. The Multiple Variant (A/B Test) question inherits all properties of the foundational question type.

Step 5: Configure Variant Allocation

Multiple Variant (A/B Test) questions can be used for both random and non-random allocation of variants. By default, participants are assigned randomly. To switch to rules-based allocation:

1. Set conditions for assigning variants.
2. Tap 'Click here' to assign variants based on the set conditions.

3. Adjust the distribution ratio if needed (e.g., 50/50 split or custom percentages).

Step 6: Make the Question Required (Optional)
If you want to require participants to answer this question, toggle the Required switch at the top-right of the panel. This ensures respondents cannot proceed without answering the question.

Step 7: Add Media (Optional)
You can upload media (images, videos, or audio files) to accompany the question. Here’s how:

1. Click the paperclip icon at the top-right of the panel.
2. Upload your media file (must be under 4MB).
3. Once uploaded, choose the alignment for the media (left, right, or center). The default text overlay will say, “View the media below, then answer the following question.”

Preview Mode

Before finalizing the Multiple Variant (A/B Test) setup, it is important to preview how it will appear to participants.

1. Click the Preview button to see the question as participants will view it.
2. Make sure all options, media, and settings look as expected.

Final Step: Push to Questionnaire

Once you are satisfied with your Multiple Variant (A/B Test) setup:

1. Click Push to Questionnaire to add the question to your live survey.
2. If you need to make edits later, you can always return to the question editor to make changes.

Example Question Setup

Question
View the image below then answer the question that follows:

Based on the packaging shown, how harmful do you think this tobacco product would be if smoked daily?

Responses

• Not harmful at all
• Slightly harmful
• Somewhat harmful
• Very harmful
• Extremely harmful

[Note: Each participant will see only one randomly assigned question along with any associated media uploaded by the researcher. Unlike randomized trials where different media are randomized to a single fixed question, here, multiple question variants are created, and each participant is randomized to see only one question.]

Additional Features:

• Required: Yes
• Randomized Variant Distribution: 50% each
• Change foundational question: Change the foundational question to an appropriate one for your Randomized Trial.
• Add Section Header (Optional): Toggle this switch to add a section header to the question for context or grouping.
• Add Footer Prompt (Optional): Toggle this switch to include a closing note or prompt at the bottom of the question.

Conclusion

The A/B Test question type in Chisquares is a powerful tool for evaluating different question formats and optimizing survey engagement. By leveraging randomized assignment and performance tracking, users can refine their content based on real-time respondent data. Whether testing product descriptions, marketing messages, or survey wording, A/B Testing ensures data-driven decision-making for superior results.

To watch a video of this question being set up, click the link below: link